ABSTRACT
BACKGROUND: The COVID-19 pandemic highlighted the importance of diagnostic testing against curbing the spread of SARS-CoV-2. The urgent need and scale for diagnostic tools resulted in manufacturers of SARS-CoV-2 assays receiving emergency authorization that lacked robust analytical or clinical evaluation. As it is highly likely that testing for SARS-CoV-2 will continue to play a central role in public health, the performance characteristics of assays should be evaluated to ensure reliable diagnostic outcomes are achieved. METHODS: VALCOR or "VALidation of SARS-CORona Virus-2 assays" is a study protocol designed to set up a framework for test validation of SARS-CoV-2 virus assays. Using clinical samples collated from VALCOR, the performance of Aptima SARS-CoV-2 assay was assessed against a standard comparator assay. Diagnostic test parameters such as sensitivity, specificity and overall per cent agreement were calculated for the clinical performance of Aptima SARS-CoV-2 assay. RESULTS: A total of 180 clinical samples were tested with an addition of 40 diluted clinical specimens to determine the limit of detection. When compared to the standard comparator assay Aptima had a sensitivity of 100.0% [95% CI 95.9-100.0] and specificity of 96.7% [95% CI 90.8-99.3]. The overall percent agreement was 98.3% with an excellent Cohen's coefficient of κ = 0.967 [95% CI 0.929-1.000]. For the limit of detection, Aptima was able to detect all of the diluted clinical samples. CONCLUSION: In conclusion. validation of Aptima SARS-CoV-2 assay using clinical samples collated through the VALCOR protocol showed excellent test performance. Additionally, Aptima demonstrated high analytical sensitivity by detecting all diluted clinical samples corresponding to a low limit of detection.
Subject(s)
COVID-19 , SARS-CoV-2 , Humans , Clinical Laboratory Techniques/methods , COVID-19 Testing , Molecular Diagnostic Techniques/methods , Pandemics , Sensitivity and SpecificityABSTRACT
BACKGROUND: Testing for SARS-CoV-2, together with vaccination, is one of the most vital strategies in curbing the current COVID-19 pandemic. The pandemic has led to an unprecedented need for diagnostic testing and the rapid emergence of an abundance of commercial assays on the market. Due to the nature of the pandemic and in the interest of health protection, many of these assays received provisional authorisation for emergency use without thorough validation. To limit false negative and false positive results, it is key to define common criteria that SARS-CoV-2 assays need to fulfil. VALCOR or "VALidation of SARS-CORona Virus-2 assays" is a protocol designed to set up a framework for test validation of SARS-CoV-2 virus assays. OBJECTIVES: VALCOR is a study protocol for the validation of assays used for confirmation of the presence of SARS-CoV-2 in patients with COVID-19 disease or the screening of carriers of SARS-CoV-2 virus by the identification of viral RNA in oropharyngeal and/or nasopharyngeal specimens or other specimens from the human respiratory tract. METHODS: The VALCOR panel of samples will contain clinical human specimens and standardised artificial specimens. The collection of clinical specimens will include nasopharyngeal or oropharyngeal specimens or other specimens from the respiratory tract obtained from COVID-19 patients and healthy carriers of SARS-CoV-2 as well as specimens from subjects not carrying SARS-CoV-2. Artificial specimens include calibrated amounts of viral RNA of SARS-CoV-2 sequences provided by established competent agencies that produce reference materials for the assessment of the limit of detection of each assay. The panel of samples are sent from a central reference laboratory (having access to biobanks of clinical specimens tested already for SARS-CoV-2 with a reference comparator assay) to participating laboratories for testing with a SARS-CoV-2 index assay that requires evaluation. DISCUSSION: VALCOR provides a harmonised and standard framework to benchmark the testing performance of SARS-CoV-2 assays that are rapidly evolving. As the pandemic incited an urgent need for testing capacity, there is a gap in the comprehensive validation of SARS-CoV-2 assays. This study will generate comprehensive validation data for assays used for the diagnosis of SARS-CoV-2 and may serve as a basis for other validation protocols.